Table of contents
- Changelog hilights
This file will contain a manually mantained log of hilights between versions, it’s not a very extensive detail, but some of the bigger changes/ideas will be added here.
Check What’s new: tag for more updated information.
--findto citellus so that it can grep across a folder set for checking historic data for tests.
- Magui autogrouping support, generating files for each comparison set like osp roles, same hostname, etc. It’s based on metadata plugins generated.
- Skip reexecution if a specified sosreport set was already analyzed.
- Implemented ‘faraday-exec’ plugin to generate fake plugins that run and output metadata that later is faked via a datahook to be compared via magui plugins.
- Implemented automatic pypi.org package generation for each master merge that allows to run citellus installed via ‘pip’ or ‘pipsi’.
- Implemented ‘profiles’ data hook
- Allow to define a text file with include/exclude filter and description that grabs data from the obtained results and shows in one place all return codes and error messages received
- This will allow to define ‘healthchecks’ based on other plugins output and generate them dinamycall.
- As it is done as if another plugin was executed, same Web UI interface is available for checking results.
Several changes introduced recently:
- New plugins :)
- When running rerun, improved some of the logic to also copy over www so that it matches the version of the json file.
- Improved rerun, to only get results for missing plugins (unless forcerun used)
- Faraday can now accept bundle of files CSV in the list of files, it will mangle the extension reported name and description to match the file iterated.
- This allows one file to act over several FS files (for example,
policy.jsonfor several services).
- Some other UT tweaks to ensure plugins report no data to stdout, and ability to drop bunch of jsons to run that UT over them.
- We moved data to be a dictionary (instead of array of dictionaries), to better and faster filter on included plugins and others that are dependant on data generated (like Magui ones).
- UT to check for tests that were doing ‘echo $RC_’ instead of ‘exit $RC_’
- Citellus www
- Now uses the generated ‘name’ for plugins so we can tune it from the framework side.
- Also, auto switches to
citellus.jsonexists, or shows a dropdown to select which one to show.
- DevConf.cz 2018 Detect pitfalls of osp deployments with citellus
- Recording at https://www.youtube.com/watch?v=SDzzqrUdn5A
Some files must be equal or different across sosreports, actually we do have
ceilometer-yamlone that rely on this, but this is hard to mantain as each new file will require a new plugin for Citellus plus a new plugin for Magui.
In order to simplify this a new extension has been created so adding a new file to monitor no longer requires new plugins for
maguibut just creating a text file with some data within as documented on
- Changed the way we work with sosreports for Citellus and Magui:
- Now all plugins are always executed and filters do act on the output only.
- If the folder is writable, citellus will write
citellus.jsonto sosreport folder.
- If there’s an existing
citellus.jsonit will be loaded from disk and run skipped unless there are new plugins that require execution. Forcing execution can be indicated with parameter
-rto both Magui and Citellus.
- New functions for bash scripts!
- We’ve created lot of functions to check different things:
- installed rpm
- rpm over specific version
- compare dates over X days
- regexp in file
- Functions do allow to do quicker plugin development.
- save/restore options so they can be loaded automatically for each execution
- Think of enabled filters, excluded, etc
- metadata added for plugins and returned as dictionary
- plugin has a unique ID for all installations based on plugin relative path and plugin name
- We do use that ID in magui to select the plugin data we’ll be acting on
- plugin priority!
- Plugins are assigned a number between 0 and 1000 that represents how likely it’s going to affect your environment, and you can filter also on it with
- extended via ‘extensions’ to provide support for other plugins
- moved prior plugins to be
- ansible playbook support via
- metadata plugins that just generate metadata (hostname, date for sosreport, etc)
- Web Interface!!
- David Valee Delisle did a great job on preparing an html that loads citellus.json and shows it graphically.
- Thanks to his work, we did extended some other features like priority, categories, etc that are calculated via citellus and consumed via citellus-www.
- Interface can also load
?json=magui.json) and show it’s output.
- We did extend citellus to take
--webto automatically create the json named
citellus.jsonon the folder specified with
-oand copy the
citellus.htmlfile there. So if you provide sosreports over http, you can point to citellus.html to see graphical status! (check latest image at citellus website as www.png )
- Increased plugin count!
- Now we do have more than 119 across different categories
- A new plugin in python
reboot.pythat checks for unexpected reboots
- Spectre/Meltdown security checks!
- If there’s an existing
citellus.jsonmagui does load it to speed it up process across multiple sosreports.
- Magui can also use
ansible-playbookto copy citellus program to remote host and run there the command, and bring back the generated
citellus.jsonso you can quickly run citellus across several hosts without having to manually perform operations or generate sosreports.
- Moved prior data to two plugins:
- Citellus plugins output arranged by plugin and sosreport
- Outputs metadata gathered by
metadataplugins in citellus arranged by plugin and sosreport
- Outputs metadata gathered by
- First plugins that compare data received from citellus on global level
- Plugins are written in python and use each plugin
idto just work on the data they know how to process
- Checks if pipeline.yaml and warns if is different across hosts
- Checks latest galera seqno on hosts
- Reports RHEL release across hosts and warns if is different across hosts
quietmode on the data received from citellus as well as local plugins, so only outputs with ERROR or different output on sosreports is shown, even on magui plugins.