← Back to team overview

cf-charmers team mailing list archive

Re: Ben: status on Acceptance Tests CI integration? Any assistance?

 

I had tried settings those, its implied in the docs that if you rake
prepare it will create additional accounts (which works) and use the first
of those automatically. The tests are almost all still failing even after
sourcing that script. There was some breakage in the bundle as you all
noted but given that the deployment I was using could push a working app I
would expect this to work as well.

I'll continue to investigate, I'd very much like to have (even a working
subset of) the YETI tests running before we can switch to CATs. If you have
any additional insights they are welcome.


Thanks,
Ben


On Wed, May 14, 2014 at 3:22 AM, Alexander Lomov <lomov.as@xxxxxxxxx> wrote:

> It seems that you'll need VCAP_BVT_USER and VCAP_BVT_USER_PASSWD variables
> additionally. You can try this script to prepare your CF installation for
> the tests: https://gist.github.com/allomov/bd0d77703df42fe29de9 (many
> thanks to Alex P. for it).
>
> Best wishes,
> Alex L.
>
>
> On 14 May 2014 02:31, Benjamin Saller <benjamin.saller@xxxxxxxxxxxxx>wrote:
>
>> I've been unable to replicate these test results on the single aws node
>> deployment.  I am hoping its getting the UAA_CC_SECRET wrong, are your
>> settings different?
>>
>> VCAP_BTV_ORG_NAMESPACE=jenkins
>> VCAP_BVT_ADMIN_USER_PASSWD=admin
>> VCAP_BVT_ADMIN_USER=admin
>> VCAP_BVT_API_ENDPOINT=http://api.<proper ip>.xip.io
>> VCAP_BVT_UAA_CC_SECRET=admin
>>
>> from the proper hashed version of YETI mentioned in the README
>>
>> bundle
>> bundle prepare
>> bundle exec rspec
>>
>> This does run the tests though almost everything fails. With the
>> deployment I'm using I've been able to push and validate that the fib-cpu
>> app mentioned in the README works, so the basic setup seemed fine. My being
>> unable to get the tests to pass or have clear insight into what is going
>> wrong has kept me from putting the CI code in place.
>>
>> http://api.54.198.98.13.xip.io
>>
>> is the current endpoint. I'll leave this up tonight and maybe you can see
>> if the tests run for you and what I'm missing in the current setup?
>>
>> Thanks,
>> Ben
>>
>>
>> On Mon, May 12, 2014 at 5:56 AM, Manuel Garcia <manuel.garcia@xxxxxxxxxxx
>> > wrote:
>>
>>> Hi Ben,
>>>
>>> Will you need any assistance from us?
>>>
>>>  - Manuel Garcia
>>>
>>>
>>> On May 7, 2014, at 1:49 PM, Prismakov Alexander <
>>> alexander.prismakov@xxxxxxxxxxx> wrote:
>>>
>>>  Hi Ben,
>>>
>>>  I spend some time comparing results of integration tests on both
>>> cloudfoundry deployments - one deployed with BOSH Lite and second one
>>> deployed with JUJU.
>>> To integrate it to our CI we need disable some tests. The link <https://docs.google.com/spreadsheets/d/17CAkRv_-vOfjBw_jgmNU6PAvIeRtWQDnD_hesdcdpIU/edit?usp=sharing>
>>> (
>>> https://docs.google.com/spreadsheets/d/17CAkRv_-vOfjBw_jgmNU6PAvIeRtWQDnD_hesdcdpIU/edit?usp=sharing)
>>> contains the list. Fill free to add your results/comments.
>>> Also sometimes some tests fail for me when I run them as a bunch but
>>> then they pass if I rerun them individually. You need to keep it in mind
>>> for CI. May be it make sense to run all tests from CI individually.
>>>
>>>  -Alex Prismakov
>>>
>>>
>>>
>>
>> --
>> Mailing list: https://launchpad.net/~cf-charmers
>> Post to     : cf-charmers@xxxxxxxxxxxxxxxxxxx
>> Unsubscribe : https://launchpad.net/~cf-charmers
>> More help   : https://help.launchpad.net/ListHelp
>>
>>
>

References