Test with multiple PyMongos / MongoDB versions

[jonashaag]

now that we have Travis.

[charettes]

We can achieve this by using an env clause for each configuration

env:
  - PYMONGO=2.1.0 MONGODB=2.0.4
  - PYMONDO=2.1.1 MONGODB=1.8.5

install:
  - python setup.py install
  - pip install pymongo=$PYMONGO -I
  - get http://downloads.mongodb.org/linux/mongodb-linux-i686-v$MONGODB.tgz
  - ...

[jonashaag]

We should probably test against multiple PyMongo/MongoDB combinations.

I think there's no point in supporting anything prior to 1.8.X so here's the list of PyMongo's we could test against

• 1.8.X
• 1.9.X
• 1.10.X
• 1.11.X
• 2.0.X
• 2.1.X

The MongoDB version I think we should support are

• 1.8.X
• 2.0.X
• 2.1.X

[charettes]

Herm I don't know Travis politics toward the number of builds allowed but testing all those configuration would trigger 54 builds...

3 pythons * 6 pymongo * 3 mongodb

IMHO it's a bit abusing... Can't we stick with 2 pymongo and 2 mongodb versions? Say the stable one and the development one?

[jonashaag]

We could reduce the amount of PyMongos supported (1.11.X, 2.0.X, 2.1.X) but we should at least test against MongoDB 1.8.X (oldstable) and 2.0.X (stable). MongoDB 2.1.X would be great to test against too because that one is going to be the next stable within a few months.

Best would be to have some numbers on version market share... (I'm pretty sure there's plenty of people still using MongoDB 1.8 out there though)

So that would lower the number of builds to 3**3 = 27. I don't think it's a timeout problem either (timeouts are at ~10 minutes per build right now).

[charettes]

Definitely not a timeout issue since they will all be run in separated builds.

Now we must find a way of installing a specific versions of MongoDB. It would be great if there was debian packages of all those versions...

[jonashaag]

There's a PPA for stable and oldstable http://www.mongodb.org/display/DOCS/Ubuntu+and+Debian+packages

If we want to test against 2.1 we probably need to install from archive.