14:04:58 #startmeeting infra weekly 14:04:58 Meeting started Mon Apr 8 14:04:58 2013 UTC. The chair is ewoud. Information about MeetBot at http://wiki.debian.org/MeetBot. 14:04:58 Useful Commands: #action #agreed #help #info #idea #link #topic. 14:05:20 the agenda 14:05:23 Introductions 14:05:23 Review of action items 14:05:23 Rydekull add the jenkins slaves to a list ont he wiki 14:05:23 quaid to setup docs sprint 14:05:23 Hosting 14:05:26 rackspace01 installed? 14:05:28 Puppet 14:05:31 Summarize the ML thread 14:05:33 Jenkins 14:05:36 Other business? 14:05:38 Trac review 14:05:53 missing anything? 14:06:35 #topic Introductions 14:06:56 anyone who would like to introduce themselves here? 14:07:40 #topic Review of action items 14:08:01 I added this to the agenda because it felt like we were forgetting to review them and sort of died 14:08:11 Rydekull: any progress on adding the jenkins slaves to the list? 14:08:37 quaid: anything on the docs sprint? 14:08:39 Hey hey 14:08:52 #admin theron_ 14:09:05 #chair dneary 14:09:05 Current chairs: dneary ewoud 14:09:16 #chair theron_ 14:09:16 Current chairs: dneary ewoud theron_ 14:09:20 Thanks ewoud :-) 14:09:22 #chair dcaro eedri|mtg quaid 14:09:22 Current chairs: dcaro dneary eedri|mtg ewoud quaid theron_ 14:09:50 * ewoud makes a list to highlight when the meeting start 14:10:19 since Rydekull and quaid aren't here, let's move on 14:10:22 #topic Hosting 14:10:38 haven't heard quaid about any progress on rackspace01 14:11:00 we should make a decission about alterway02 and the network 14:11:22 #chair eedri 14:11:22 Current chairs: dcaro dneary eedri eedri|mtg ewoud quaid theron_ 14:11:23 * eedri here 14:11:36 16:10:58 < ewoud> we should make a decission about alterway02 and the network 14:12:02 ewoud, did you got an answer from alterway? 14:12:03 do we go for NAT or wait for additional IPs? 14:12:14 eedri: nothing that's not on the ML 14:12:25 ewoud, how would we use nat? 14:12:33 but he said on April 17 he could have something 14:12:33 ewoud, don't we need public ips to access it? 14:12:52 eedri: alterway02 has one public IP and we could NAT it there, but I'd rather not 14:13:11 ewoud, doesn't sound right to me too 14:14:18 maybe I'm a bit spoiled since my employer has 4096 IPs (and a /32 IPv6 block), but not having to resort to NAT would make our lives easier 14:14:43 ewoud, does the ip space have to come from alterway? or we can use other resources? 14:15:06 eedri: not sure how else you'd do it 14:15:08 dneary, is rackspace providing us with ip space for the hosts? 14:15:26 dneary, vms actually 14:15:27 eedri: then what? use a VPN? 14:15:51 ewoud, yea.. it will complicate things 14:16:34 what we could do is use a reverse proxy on the host 14:17:02 ewoud, so each vm will have a private ip 14:17:17 ewoud, and the host will have a revesve proxy directing it to a dns name 14:17:43 eedri: yes, but then we still need NAT or a HTTP proxy for yum updates 14:17:59 eedri: and something like a VPN to SSH into the hosts 14:18:16 ewoud, i say let's wait till april 17 (which is a good date, since it's my bd..) 14:18:19 +1 14:18:23 ewoud, so good things might happen 14:18:27 eedri: no kidding, mine too 14:18:28 ewoud, eedri, are you talking about http reverse proxy? 14:18:33 ewoud, really? 14:18:37 eedri: yes :) 14:18:41 ewoud, cool :) 14:18:52 dcaro: +1 was on the waiting 14:19:07 dcaro, we can use revese proxy, but it will complicate things 14:19:35 ok, can we get an update on rax servers? 14:19:55 it will only proxy http then :S, we need more services right? 14:19:56 worst case you'd turn alterway02 into a host without virtualisation and make it a new kitchen sink like linode01, but I'd prefer not to 14:20:09 dcaro: yes, mail for mailman etc 14:20:23 eedri: no updates afaik 14:21:39 quaid, ? 14:21:40 so we wait for April 17? 14:21:47 ewoud, for alterway i vote +1 14:21:58 +1 14:22:11 ewoud, i would like to get progress on rax, since it's blocking us from running pre-patch jenkins jobs 14:22:26 #agreed we wait for April 17 for more IPs from Alterway 14:22:27 ewoud, i can run some jobs on jenkins master, but i rather not 14:22:41 eedri: +1 14:22:45 * Rydekull is here 14:23:04 maybe we should share the login credentials for rackspace so quaid isn't a SPOF 14:23:07 Oh, rats, I'll be here in a minute or so 14:23:10 * Rydekull goes again 14:23:19 quaid, dneary ping 14:23:32 quaid, can we help in pushing forward rackspace installation? 14:23:42 eedri, Hi there 14:23:49 dneary, ^^ 14:23:52 eedri, I don't know if quaid is around this morning 14:24:00 dneary, just wondering how we can push forward raxs 14:24:34 eedri, My suggestion is to ensure that you, dcaro, ewoud & theron_ have access to anything which is blocking with quaid 14:24:50 dneary, sounds good. how can we make it happen? 14:24:57 eedri, Email to infra@ highlighting the problem, and I'll make sure quaid sees it & takes action 14:25:20 I'm sure quaid will agree 14:25:38 I'll send the mail 14:25:46 ewoud, +1, thanks 14:26:10 #action ewoud mail to infra@ to make sure we don't have a SPOF on people with access 14:26:18 anything else about hosting? 14:26:30 ewoud, maybe asking racs space 14:26:34 ewoud, about ip space 14:26:44 ewoud, so we won't have issue when the host is installed 14:27:04 eedri: mind picking that up? 14:27:57 ewoud, sure 14:28:11 #action eedri to send email about ip space on rackspace servers 14:28:26 ewoud, btw, we've managed to install some nested vms running rhel on fedora18 14:28:36 eedri: nice 14:28:46 ewoud, so it seems we'll be able to do that on rax as planned 14:29:23 ok, that's enough about hosting I think 14:30:03 #topic puppet 14:30:40 I haven't had time to build a proof of concept so I wanted to install on alterway02, but ran into the IP space problem 14:31:28 ewoud, are you planning to run foreman + puppet master on same vm? 14:31:39 eedri: yes 14:31:50 ok 14:31:51 +1 14:32:00 and the puppet classes cloned from git repo? 14:32:26 I plan on using the foreman installer to install it 14:32:41 ewoud, sounds good. we're using 1.1 stable here 14:32:46 I've provided quite a few patches to it and I know it well 14:32:57 same, 1.1 works well 14:33:22 btw, went to puppetcamp amsterdam last weekend and it was great fun :) 14:33:29 last friday* 14:33:40 ewoud, did you meet dcaro ? 14:33:45 dcaro, you were also there, no? 14:33:45 eedri: was he there too? 14:33:58 nop, I was a few weeks before 14:34:25 but they were talking a lot about the puppetcamp 14:34:41 eedri, hey - you were looking a bit after jenkins, right? 14:35:06 anyway, at $employer we imported the foreman installer modules into our regular environment and I'm wondering if we want to do the same 14:35:33 do you guys also use the git hook to build the environments? 14:35:35 btw, ewoud, i'd like to get a little more involved in puppet/foreman, if you need help just ask 14:35:53 ewoud: yes, the git hook updates and creates the envs if needed 14:36:01 fabiand, we're in the middle of infra weekly meeting 14:36:07 fabiand, is it related? or it can wait? 14:36:20 dcaro: I will, but I find it hard to work on it without an actual foreman server 14:36:27 eedri, oops - It can wait! 14:38:37 dcaro: I also prefer to start working on git repo with modules 14:38:46 ewoud: ok, maybe we can add features to the puppet modules meanwhile 14:38:46 should we start on github or straight to gerrit? 14:40:05 dcaro: what features? 14:40:41 * quaid daylight savings confused, thinking he is early 14:41:35 quaid: oh, maybe that's true 14:42:17 recently here we switched to summer time, though it's not really that much summer 14:42:44 israel also switched last week afair 14:42:50 ewoud: for example the user creation and privilege separation 14:43:20 (one user per admin, sudo profiles, etc..) 14:44:26 dcaro: long ago I started on https://github.com/ekohl/ovirt-infra-puppet so maybe we can expand that 14:45:54 ewoud: ok, let's talk the details on the list, maybe start a new thread on puppet modules/features that we need 14:46:32 argh, been playing with my PC this weekend and now I have some instabilities 14:46:54 anyway, long live a spare laptop 14:46:57 dcaro: +1 on that 14:47:38 #action ewoud restart the puppet ML thread 14:47:49 back! 14:47:52 let's go back to hosting 14:47:58 #topic hosting 14:48:07 quaid: any news on rackspace? 14:49:18 ok, so 14:49:46 I'm still as stuck as I was a few weeks ago, it's caused me to be totally shy of the project 14:50:42 the problem is that I don't know that I can easily add anyone to the system to get console access 14:50:54 once hosts are installed, that's different - we should be able to get ssh access more easily 14:51:04 but to get to the iDRAC is a bit more 14:51:24 if there is anyone who knows they can get the iDRAC console to work on their host - I seem to be having a Java and browser problem ... 14:52:41 Yeah, fix java and use the correct browser :-P 14:52:52 clever! 14:52:54 You usually dont have much more options then that :-) 14:53:29 I may try from a local VM 14:53:42 anyway, I get that it's important, I'll keep at it this week 14:53:46 So your actual issue is that you dont get your console to start? 14:53:54 from DRAC? 14:54:10 I get it to start, and I can go through to what is really the first screen of Anaconda 14:54:27 And it doesnt work in text-mode? 14:54:28 quaid: anything from rackspace support? 14:54:29 in text mode, I get a blank console, and only when I hit reboot the server from the console menu do I see that I'm in Anaconda 14:54:33 hrm 14:54:42 ewoud: plenty, but not entirely useful in the end 14:54:48 quaid: can you do a kickstart? 14:55:08 No way me or ewoud could take a peek at it? Perhaps a teamviewer session with you in it 14:55:11 or something 14:55:16 solve it together 14:55:21 I think so, if it will use a local .ks file of if I get rackspace support burn it all to a CD and hang a drive locally 14:55:37 or over network 14:55:42 quaid, have you tried with internet explorer on a win vm 14:55:45 can you select a kernel image? 14:55:45 * eedri ducks 14:56:02 quaid, usually that works when i have an issue with java plugin for ff 14:56:03 eedri: I don't have a win VM, so no I haven't tried taht 14:56:14 ewoud: I think so, yes 14:56:29 with OOB-solutions, IE is sometimes what is needed to be honest 14:56:55 does anyone have an F18 kickstart file I can use? maybe one of our Jenkins installs? 14:57:19 quaid, i should have one in our foreman instance 14:57:27 hello, here again.. 14:57:48 eedri: can you email that to me? 14:57:53 is there any reason why I can't see all ActiveDirectory users after connecting the domain to ovirt? 14:57:56 quaid: actually, just thinking here a bit 14:58:20 quaid: could it be, when you start textmode that your console gets changed to another com-port or even a VGA-card in that machine? 14:58:25 mmornati: we're in an infra meeting, after that people are more likely to be able to help you 14:58:38 thanks ewoud.. I can wait... 14:58:45 quaid, http://pastebin.com/bbx29wEM 14:58:47 quaid: I dont know how that machine is equipped, but you could perhaps make sure in BIOS(UEFI) that it is just using the internal VGA 14:58:58 quaid, it might have some foreman variables in it 14:59:08 Rydekull: I'll check, thx 14:59:24 quaid, anything with <% ...%> 14:59:31 quaid: http://ekohl.nl/kickstart is what I use for my centos 6 kickstarts 14:59:35 quaid, should be replaced with strings 14:59:50 well, still trying to do F18 15:00:01 I was able to get CentOS 6.4 to work (didn't complete the install) 15:00:10 quaid: anyway, both me and ewoud can probably try and work with you remotely to try and solve it through teamviewer or something. if not 15:00:13 quaid: I know, but it's my experience with kickstarts 15:00:17 quaid: provide you with a windows vm where you can try and do the same :-) 15:00:39 quaid, sent you link to f18 kickstart file 15:01:09 Rydekull: I'll take the help, thanks, but will skip the win vm 15:01:11 quaid: if you have SSH-access, using DRAC that is, you might be able to switch the console output to a console also, and then connect there 15:01:25 quaid, maybe it's possible to use crossover/wine? 15:01:30 quaid: err, com-port I mean 15:01:31 quaid, to run ie.. but i never tried 15:01:54 eedri: I have in the past but don't know if it works now, presuming I can get a distribution of IE 15:02:16 quaid: sufficient suggestions on how to continue? 15:02:33 then I'd like to return to the review of action items 15:03:00 yes, thanks, sufficient :) 15:03:44 #topic Review of action items 15:03:47 Rydekull add the jenkins slaves to a list ont he wiki 15:03:49 quaid to setup docs sprint 15:04:02 I added this to the agenda because it felt like we were forgetting to review them 15:04:03 No update, but you will see an update this week. For sure. 15:04:13 I've gotten my life sorted, so I should be more active :-) 15:04:43 Rydekull: anything we should be concerned about or just busy with other things? 15:05:02 Other stuff, my life :-) 15:05:28 I think that's all too familiar for all of us 15:07:57 quaid: any news on the docs sprint? 15:09:15 I'm assuming not 15:09:18 #topic jenkins 15:09:28 let's round up quickly 15:09:41 eedri: I think most improvements are now blocked on rackspace? 15:10:15 ewoud, yes 15:10:26 ewoud, we would very much like to start running jobs per patch 15:10:33 ewoud, but we can't on current infra 15:10:39 eedri: ok 15:10:42 ewoud, so we need stronger vms runnign on rackspace 15:11:07 eedri: don't we run jobs for vdsm? or do you want to expand that to engine? 15:11:46 ewoud, yes. like findbugs 15:11:54 ewoud, it something we see from time to time 15:12:02 eedri: ah yes 15:12:04 ewoud, engine commits are on much higer volume 15:12:07 ewoud, than vdsm 15:12:07 that's rather CPU intensive 15:12:45 #info would like to run per patch jenkins jobs, blocked on rackspace 15:12:50 #topic other business 15:12:59 anything we missed? 15:13:37 quaid: is the meeting time still OK for you or is it very early for you now? 15:16:38 given the time I'd like to close the meeting and skip the trac review 15:16:52 going once 15:17:00 going twice 15:17:08 gone 15:17:10 #endmeeting