Home›Notes›Dolphin 7.0.4 Development Status

Andrew Boon

576 days ago in Dolphin Development
Tags: dolphin, security, spam, beta
Reactions: 43 comments •5 points•0 reports
 
 

Dolphin 7.0.4 Development Status

As you may guess we're now preparing Dolphin 7.0.4 and hope to run beta next week. 7.0.4 includes some additional optimisation of slow queries and bug-fixes. Not only that, though...

SPAM Control Tool

The major new addition in 7.0.4 is SPAM CONTROL TOOL. We're adding 3 methods of automatic SPAM control - DNS Blocklists, URI DNS Blocklists and Akismet. Early testing shows great results and we hope to provide an effective way to keep your sites clean of trash. We can't wait for this release, since even our own Boonex.us is severely infected with regular SPAM posts (which comes handy for our testing).

Stay tuned!

Plus
Comment•Report
 

Plussed by

 
 
 
 

Comments

Oldest First
|
Threaded
 
 
Please login to post a comment.
tomakali
tomakali•576 days ago
 
Great.
adding admin modules like Auto-profile validation is good to.
after 100s of profiles joining, validating those email ids which are expired, duplicate etc is aggressively insane job
Permalink•Reply•Plus•0 pluses
ilbellodelweb
ilbellodelweb•576 days ago
 
Good news.
Thank u Andrew!
Permalink•Reply•Plus•0 pluses
patrick81
patrick81•576 days ago
 
Nice! I can't wait! :)
Permalink•Reply•Plus•0 pluses
piprat
piprat•576 days ago
 
Thanks Andrew, I would like to mention something to you about the D7 image management.

As all the images are dumped in ONE folder, site/modules/boonex/photos/data/files/ isn't this going to create problems once numbers of files become quite large? EG, I can not view more than 10K files in this folder as my host (Arvixe) limits the number of file views via Cpanel or FTP for security on their shared servers. This means I can only view and edit a truncated amount which used to be only 2K until I see more raised this issue with them. I was not aware of this situation until I needed to delete some images and could not do it as I could not even view them and had no idea what was going on.

With D7 making 5 files per image, I reach my view limit at only 2K members with images. Not many is it?

Many other D7 users would be in the same boat as me, on shared hosting. What happened to the individual ID folders as in D6? Is there a reason I am not understanding as to why all images are in one folder? There must be a valid reason for you to take this move.

Isn't there a file limit placed on a folder anyway? I have been told it is 32K, which is only 6K members with images, still not that many is it? Can we have a fast site with 100K or more files in ONE folder? How to edit and view these if we need to, as I can't do anything now, let alone once things grow.

Some food for thought. Your input would be most grateful, thanks.
Permalink•Reply•Plus•0 pluses
danielmarseille
danielmarseille•576 days ago
 
can you do something?

D7 is an incredible software and I do not understand why you do not correct this problem
it's really unnecessary and annoying to see all private
is of no interest to our members - it devalues your software
all ads - has no private photo - why not do the same for :
all photos - Photo albums- videos home - all videos - recent groups.........

http://www.boonex.com/unity/forums/topic/7-0-3-really-horrible-all-photos-all-videos.htm

Dolphin 7 (Hookie) Final!
Posted: see more 25.12.2009 - by Andrew Boon
After OVER a year of development, 17 Alphas, 8 Betas, 5 RCs,
http://www.boonex.com/unity/blog/entry/Hookie

Today is 28/10/2010
It's been almost two years since you started the development of D7

you not think it is time to solve this problem
why not take advantage of the release of D7.0.4 - to finally resolve this problem
Permalink•Reply•Plus•0 pluses
jyi123
jyi123•576 days ago
 
First of all, I strongly agree PIPRAT's opinion that D7 needs to use some hierarchy for all the files uploaded, photos, videos, audio and etc, not just dumping into a single folder resulting hard to management.

Second, I've raised the same issue as Danielmarseille's since D7 starting development that all private blue lock should not be display to the current user because they are nosecone to current user.

Hope these issues will get improving from D 7.0.4 and above.
Permalink•Reply•Plus•0 pluses
elcentcom
elcentcom•576 days ago
 
akismet does a great deal in spam control, thanks for this.
Permalink•Reply•Plus•0 pluses
selo12
selo12•576 days ago
 
I am VERY IMPRESSED by the7.0.3 update, and with 7.0.4 it looks like it will be even better..
Permalink•Reply•Plus•0 pluses
Nathan Paton
Nathan Paton•576 days ago
 
I've been looking forward to the anti-spam features ever since I saw the first changeset. Is there any chance you'll also work on the captcha, too? I know a few people (myself included) would prefer something like reCaptcha integrated into the script.
Permalink•Reply•Plus•0 pluses
Andrew Boon
Andrew Boon•576 days ago•in reply to Nathan Paton
 
There's a little problem with reCaptcha... one has to register with them to make it work. This complicates installation. We're looking at it though, might just make an extra module.
Permalink•Reply•Plus•0 pluses
AlexT
AlexT•576 days ago
 
@piprat

Old structure was even worse because there is 31998 limit sub-directories per one directory in ext2,3 filesystem and there is no limit (or it is very high) for number of files per directory. Now you are talking about limits of the software you are using for browsing, but not system limit.

In the future we will consider structure like this /a/b/c/d/abcd4543564.jpg, it will solve both problems, yours (with software you are using) and filesystem limits.
Permalink•Reply•Plus•0 pluses
piprat
piprat•576 days ago
 
@AlexT,

Thanks so much for explaining it to me and others who will read this thread. I look forward to the new structure being implemented and a patch to upgrade.
Permalink•Reply•Plus•0 pluses
Morocco
Morocco•575 days ago
 
Thanks Andrew -

I would definitely put more emphasis on security in D7.0.4. Dolphin has been improved a great deal no doubts about that. But imagine driving a Porche with a Toyota engine. In other words, Dolphin is such a sophisticated application, but when my site gets bombarded with SPAM, all of sudden it becomes a hub for advertisements & SPAM and it becomes irrelevant as result. At times, I just want to shut it down because the SPAM I get is so overwhelming.

One security hole I see more have yet to figure out, at times my members receive personal emails from females telling them that they like their profile and they want to share their pictures with them. In fact, I get those emails myself from Boonex.com and from my Dolphin site. What I find very troubling, is my hosting company allows only 500 emails to be sent out from my account, but how is it possible a personal email gets sent out to all of my 10,000 members at once? How is this person gets access to ALL of my emails in my database? I’ve been getting lots of complains from my members about these type of emails, and I have yet to figure out how to stop that..

Lastly, I would look into implementing some type of security against DDoS. Distributed Denial of Service will not only bring the site down, but it will bring the whole server down to its knees and at times the whole network. I am not sure if this type of attack can be implemented around the Application or within the Server, but thought to mention it because I’ve seen how effective this type of attack is.

Keep up the good work. D7.0.3 is a Porche indeed :)

Regards,
@AJ
Permalink•Reply•Plus•0 pluses
gameutopia
gameutopia•575 days ago
 
@morocco
If you have an problem with the number of emails allowed or get marked as spam than most likely it would be an issue with your host or hosting plan, not dolphin specific. You need a higher profile plan that can handle all of that.

ddos is on your end or hosts end too. Nothing to do with dolphin. Shared hosting will block it to some extent, but if it happens regularly or becomes a habit they will not tollerate it for too long. You need more control, perhaps vps or dedicated, and then see more it will be up to you rather than the host to take care of it. Otherwise you can pay for someone else to handle it. They often do not handle it that well. Depends on what you are willing to pay for that option. A few dollars per month usually doesn't take care of it. For a few hundred it probably will, but most do not want to spend that kind of cash.

Most of what you suggest is on your host side and nothing to do with dolphin. So you might see what you can do based on what your type of hosting allows, or upgrade to a plan that gives you more control over it.

None of what you mention seems to be a security hole, but a hosting allowed or capped type of thing. They have certain limits which you have reached or not allowed. So most likely you need a bigger, more powerful, or a plan that allows more plain and simple. You have out grown your host.
Permalink•Reply•Plus•0 pluses
DosDawg
DosDawg•574 days ago
 
GameUtopia,
in reference to emails allowed, that is correct, that is a hosting package setting. however, email being marked as spam, and i have been battling this from Dolphin v5, the email templates are deemed as 'spam-like' by MSN Hotmail, live.com. based on their spam filtering algorithm, the format of the templated emails are a problem.

Case in Study:
site launched on new VPS
dedicated IP assigned
IP entered into Microsofts JMRP (junk mail reporting program)
one week later after admin see more fired 9k emails which are allowed on the server IP was blacklisted on msn, hotmail live.com because of spam-like email

granted, I scolded the account holder, because i have spent well over 150 hours submitting my IP's to these czars of email delivery services. but the fact of the matter is that all email addresses were provided by somebody who registered on the site and provided the email address. there was no report of spam coming from that IP, the spam filter picked up the templated emails as 'spam-like'.

so whereas boonex is making strides in making the application better, there are still some weak links that have not been addressed. one would be the email verification. yes there is a method on the site, I dont think it works efficiently. also the templating sytem needs to be addressed because it has clear issues.

I would actually like to see the ability as a core element to be able to deny from specific email extensions. actually have had requests for this same feature in the past, where you would be able to block msn email addresses or other known spam used email accounts such as yahoo or hotmail.

Regards,
DosDawg
Permalink•Reply•Plus•0 pluses
DosDawg
DosDawg•574 days ago
 
Old structure was even worse because there is 31998 limit sub-directories per one directory in ext2,3 filesystem and there is no limit (or it is very high) for number of files per directory. Now you are talking about limits of the software you are using for browsing, but not system limit.

In the future we will consider structure like this /a/b/c/d/abcd4543564.jpg, it will solve both problems, yours (with software you are using) and filesystem limits.

the sub-directory structure was/is relevant see more to a 32bit OS running a specific build. ext3 still retains the 32000 subdirectory limitation, but its not the subdirectory structure, its an issue with creating links:

A safe way to try it out; create a relatively small file (like 20MiB), format it with ext3, mount it, and see how many directories you manage to create ;)
I did try on a VM, and I only managed to produce 5123 subdirectories in a/ before it said: mkdir: cannot create directory `xxxxx': No space left on devicekblft is correct; the limit is on a per-subdirectory basis. You can have more than 32,000 subdirectories in a filesystem, just not in a single subdirectory. I did some tests on this recently.
That seems to contradict with the results I've got from geirha's code? Any ideas why?
I expect ext4fs will be more reliable in 6-12 months. Beyond that, Btrfs is likely to become the "top dog" among Linux filesystems. At the moment, though, Btrfs is even newer than ext4fs, and I wouldn't trust Btrfs with valuable data.
At the moment I think "ext3" still works for me. Although data on my development server isn't really that valueable, I like my machine to be stable. So if I don't need to change to another (less reliable) filesystem I prefer not to change. Thanks for the information anyway.
Permalink•Reply•Plus•0 pluses
DosDawg
DosDawg•574 days ago
 
Edit:
I tried it again (same VM) but this time in the "real" filesystem.
I created /tmp/a/ and /tmp/b/ and /tmp/c/ and ran this command in all three dirs:
echo {1..32000} | xargs mkdirThis time it only came up with an error on 31999 and 32000 (seems correct, see #1: "There is a limit of 31998 sub-directories per one directory, stemming from its limit of 32000 links per inode.")
My best guess is that 20MB just is not enough to store that amount of directories.

Source: http://ubuntuforums.org/archive/index.php/t-1445914.html

ext3 see more is not a preferred filesystem if you are running dolphin on 32bit OS. If you upgrade to 64bit OS, the problem is solved.

Regards,
DosDawg
Permalink•Reply•Plus•0 pluses
hotpointis
hotpointis•573 days ago
 
Hi, SPam Guard is good,
Does this version have a "Delete" button to delete pages? I can find out how to delete a page I created.
Jim
Permalink•Reply•Plus•0 pluses
piprat
piprat•573 days ago
 
@DosDawg and AlexT

I have been testing the current D703 file system. I was able to create and dump over 35k files in the images folder and it is still working, although I must admit things have slowed down a lot when creating the image files. so if there is a 32k file limit, it has been surpassed and things are still chugging along. But only a demo site for testing is being used, so no load on it and the files have only been small, under 300k, most 50k, and no 2Mb photos like some members will see more want to upload :-)

The a/b/c etc subfolder system sounds like a good option, to keep a max of 9999 ID folders in each subfolder, if I have understood it right.
Permalink•Reply•Plus•0 pluses
Robin
Robin•573 days ago
 
Hello,
I haven't been on this site in a while and just stopped in to say hi to Boonex.

Couple of comments.

Very happy with Dolphin.

- I noticed a big change moving from Dolphin 7.0.2 to 7.0.3. Im still running my site on a shared service. Over all upgrading from .2. to .3 helped out a lot, enough to see the difference in my case anyways.
- my site loads faster and I defiantly noticed LESS database query Errors, big difference here. If im not mistaken, ever since the upgrade i only received see more one query error. I'm not an expert on programming or on database management which I'll leave to the experts on this site but as an end user of Dolphin I'm happy with the results.

I also noticed the error log found in the cpanel has next to nothing in terms of errors messages. before the upgrade i would have a tone of message which always WORRIED me but again, the upgrade pretty much cleaned the error log out.

Keep up the good work and I wait your upgrade from .3 to .4

Opinion/view from non-expert.
Cheers
R
Permalink•Reply•Plus•0 pluses
dolphinbugfixing
dolphinbugfixing•573 days ago
 
@7.0.4 includes some additional optimisation of slow queries and bug-fixes.

I love to find out if sql queries with LEFT JOIN, INNER JOIN or RIGHT JOIN are replace with more faster sql queries.
Permalink•Reply•Plus•0 pluses
Show more comments »
 
 
 

Site Search

Market

Notes

Websites

 

About BoonEx•Terms•Privacy•Contacts•© BoonEx (ACN 127966581)

PET:0.062221050262451