A nifty little tool to find all the distinct values in all columns

A few months ago I became quite frustrated because I had a huge backlog of work to do performing the Quality Control of the analyses of my team members. A large portion of performing this type of Quality Control was getting a sense of the data ingested by the analyses and determining if there were […]

Creating anonymized pseudo-random IDs

I sometimes need to convert a series of unique sensitive IDs into a list of unique IDs which I can use to share with people who aren’t allowed to know the IDs in the first list. The very easiest was to do that in SQL is to either use the HASHBYTES function in T-SQL and […]

Pivoting a table when you don’t know how many columns you need with dynamic SQL

Here’s the situation, you’ve got a column in a table which you want to pivot on but you don’t have any control over the distinct number of values that can be in that column. It could be 3 or it could be 20. However, you still need to be able to pivot the whole table […]

How to include several values in one field in SQL

I found out the other day how to solve a problem that had been causing me issues when presenting data. I often got requests to resent data in such a way that we display information from a table in a grouped form while still allowing someone to consult all of the values relating to this […]

Getting the number of lines in multiple csv files with Powershell v1

To find out the number of lines in each file of a bunch of csv files in the directory tree you can run the following snippet:

A function similar to first or last from access in MS SQL

I’ve been looking for a while now to find a way to return just one row when the fields I am using split up my table return several rows per unique field combination. I found this little gem today:

This of course does not emulate first and last exactly as it doesn’t really allow […]

Finding hidden characters in Excel

Did you know that you could search for hidden characters and replace with hidden characters in excel? Simply type:

To find any non-printable characters.   Here are some handy Ascii codes:

Mobile Sink Transfer Methods

In the final year of my studies at the University of Oxford I joined a research group which was working on a sensor network. My work consisted in investigating reliable transfer methods between the nodes of the sensor network and a mobile sink which would travel through the network and gather all of the data […]

Gait of a Six-Legged Robot

  When I studied computer animation at university I did some very interesting work for the final project. Along with several questions about rotation calculations and collision detection the project asked us to animated a six legged robot walking in a 3D environment and turning. If you are interested in this project I have uploaded […]

Sketch Shading

For my Bachelors thesis (2008) I designed a method for rendering 3D models in a non-photorealistic way allowing the models to appear sketched. While the material I present in my thesis is not very complex, I present a completely novel approach to rendering models so that they appear sketched in real time. Abstract This project […]