Amazon Aurora for the RDS

Tags

, , , , , ,

Being a user of MySQL (5.6) on the Amazon RDS I was impressed with the announcement of Aurora. Having said that I was also suspicious as to it’s providence. Nowhere were there references to it’s origins or engines. Databases and database systems don’t just drop out of the sky.

Amazon were also was making comparisons to MySQL version 5.6, not the newest version 5.7.x. This is interesting as I have been fighting I/O issues in the RDS implementations of MySQL 5.6.x for sometime. Version 5.6 has serious Mutex issues in I/O and from my reading MySQL 5.7 has managed to improve that situation. But the Amazon folks have not managed that upgrade yet.

Software politics being what it is, especially with regards to Oracle, whom own MySQL, indicates that there will be licensing issues with the release of MySQL 5.7.x. Issues that Amazon may be seeking to side step or ameliorate with the threat of Aurora (or MariaDB).

Having said that, many of the DB community seem to be of the opinion that Aurora does not offer anything that can’t be found within the MySQL 5.7 upgrade, as far as performance is concerned.

What does concern me is the lack of transparency about the nature of Aurora. What I see is smoke and mirrors. And frankly in the DB community, that does not lend trust to the Aurora project of Amazon’s. Not a good thing where trust, and dependability are Keys. (pun intended)

AI (Artifical Intelligence)

Tags

, , , , ,

There are a number of AI movies arriving in the near future, and the thought that seems to run through them all is that AI, Artificial Intelligence is depicted as being contained within humanoid constructs, frequently Female Humanoid. It brings up several interesting notions;

  • If one of the defining characteristics of AI is being ‘Self Aware’ can a computer, an AI contained within a box become self aware?
  • Does it need sensors to see, hear and touch itself to become aware of it’s existence?
  • Would a box be more or less likely to to identify with Humans if it identified itself as a box that thinks it’s alive?
  • Does an AI contained in a Female humanoid framework Identify with Female Humans? (and maybe hates Male Humans?)

All interesting things particularly in the event of an AI operating IoT (Internet of things) within a persons house. How would it ‘identify’ with the Humans, cats and dogs residing therein?

More than enough Ideas to make movies about.

Could an AI really be that angry about not having reproductive sex?

MicroSoft Weasel Words

Tags

, , , , ,

The boys at the office have been experimenting with Redis at the office however the server they were using was a Windows Server, and therefore the Redis database was running on Windows. So I took a look at the ‘release notes’ from Microsoft and their ‘Lawyer Speak’ was all over it.

 

MSOpenTech™ Redis on Windows

We strive to have a stable, functionally equivalent and comparably performing version of Redis on Windows. We have achieved performance nearly identical to the POSIX version running head-to-head on identical hardware across the network. Aside from feature differences that help Redis take advantage of the Windows infrastructure, our version of Redis should work in most situations with the identical setup and configuration that one would use on a POSIX operating system.

Having seen this type of language from Microsoft before, in ‘Open’ products like LDAP and ODBC where Microsoft would alter the implementation specification standards to suit themselves, I am wholly obliged to translate their opening paragraph into English for those who don’t ‘get it’. The paragraph should read as follows:

Microsoft’s Proprietary version of Redis for Windows
We have not managed to achieve a stable, functional equivalent or comparably performing version of Redis on Windows yet. We have managed to produce performance almost as good as a POSIX version running head-to-head on identically throttled networks connections. Aside from the changes we had to make to enable it to work within a Windows infrastructure, our version of Redis (using a Microsoft infrastructure) could almost perform using a setup and configuration that looks like a Posix operating system.

Reads a bit differently doesn’t it.

I have warned the developers here not to implement a production system based upon Microsoft’s version of Redis. I do not have anything against Redis, just the dark hole MS expects developers to jump into again.

IT, is not always a boy’s game, by choice.

Tags

, , , ,

I’ve been having a few twitter conversations about Internet startups, IT development and the ‘Boys Club’ it always appears to be. I’ve been working at a Internet Company, more than a startup, less than a powerhouse. And what was once called TeamworkPM.net is now called Teamwork.COM with the recent purchase of that very domain name.

Several Ladies have commented, one in Australia and another in California, particularly on the photos we had up for the ‘re-branding’ event.

However this is NOT the whole story, we have tried to hire NON-WHITE-NON-MALE personnel, We have held ‘Open Houses’, posted all over Cork (Home base) out of 10 (very disappointing) no persons of color, and only one woman. No one really qualified, as even the universities aren’t teaching what students need to get into the computing environment. We weren’t even trying just for ‘programmers’ none of the people bothered to even find out what we did on the Internet.

We have had interns (1 Male 1 female) in, and while useful, they were more interested in finishing school than working for us. Last year Teamwork.com set out to hire 10 people, more than doubling the staff, and we managed only 4, not all developers, from Lithuania, the Netherlands, Australia and Bulgaria. All male, all white. And it’s not our choice, it’s all that we are presented with that are educated and/or interested in working with us.

In Catholic Ireland, the Nuns still teach that Math and Science (and technology) are for the ‘boys’ and tell the girls to choose something else. Only since things like Coder Dojo’s have girls been learning coding and web development. And even there, the female component constitutes only a minority.

Until such time as females are educated, and qualified to develop code, or web working. The all-white-all-male club will be more the norm than than in the general populations. And you can’t enforce a gender balance on startups and lean companies, it would crush them. Only educations will change this imbalance. So please stop complaining about us, and others, and start sending your daughters, wives and girlfriends to school.

So if you are qualified and motivated send a CV or drop an email at Teamwork.COM

Hiding in plain sight

Tags

, , , ,

In this age of ‘Big Data‘ the masters are the ones who hide in plain sight. If you generate billions of media bits that must be parsed by the powers that be, the devil really is in the details.

During a stint in a fraud unit I learned that the trick wasn’t to read all the monitored data, but to build patterns of ‘normal’ for everyone monitored. If the patterned changed then something had changed, and an investigator was assigned.

Another article I keep remembering is an interview with a ‘Ninja Assissan’ who was quoted as;

” I never sleep in the same bed two nights in a row (he had 5 bedrooms), and he never ate the same thing for breakfast (though he always ate what he wanted)

Hence the pattern he would generate would always be random, and therefore a consistent repeated event would be considered abnormal and a ‘red flag’ that something wasn’t normal.

So to hide, and maintain privacy would be to either overwhelm the bit watchers, or develop such a random lifestyle as to make normal pattern matching methods useless.

anyone want to be a Ninja Assissan? 

Language of computing

Tags

, ,

I was reminded this Christmas Holiday season that computers do not ‘know‘ any human language, only binary, and that it takes humans to provide the translation from the machine to something human readable. And while most computer programing languages are ‘English’ like, they need not have to be in the English Language. It’s just what’s what happened first, and could be changed into another language at anytime.

This came to me in an inspired way, by listening to Carols, where non-native speakers were singing in latin, and other non-english speakers were singing in English, or German, or French. That you can sing in a language, and not know how to speak in it.

I suspect that is the same method that most non-english speakers program computers in ‘english like’ programing languages. By layering another translation over the programming, or like in singing, which uses another part of the brain, different from the part that provides language skills, another part of the brain is used to converse with computers. Thus making the point that people who program, do think with altered brains.

Future Computing

Tags

, , , ,

Note to self, the computer is not built to do anything other than execute instructions, hardware advances over the years have only advanced the ability of the CPU to gather instructions, it does not make decisions about what to execute, or in what order to execute them in. That is the organization of the basic boot loader, in combination with the operating system loaded.

There are no elements of artificial intelligence built into the hardware, it has no ability to reprogram itself or to change it’s wiring. External forces must be applied to force change either by altering microcode-code in the core of the CPU (should that be possible) or by execution of programs within the confines of the operating system, instructions provided by the boot loader or via operating systems loaded and executing programs. It is through those processes that constitute what a computer does, with what it ‘sees’ .

Any hope of producing the next generation of computing must therefore be a revolution in how the CPU is instructed to perform it’s instructions, what is done with the output, and any associated hardware connected to the system to perform ‘tasks’ assigned by that process. The argument that Windows, or Linux/Unix or any other operating system is better than another DOES create opportunities and restrictions uniquely to any new programming, computing Paradigm.

Anything like artificial intelligence will have to preceded by a new suite of hardware, with a new way of ‘booting’ the system and or an entirely new operating system tailored to artificial intelligence operations. Current hardware/software standardization is at once the primary blockage to any future advances to computing.

UPDATE #1: IBM Creates Custom-Made Brain-Like Chip

I must work for Amazon

Tags

, , , , ,

Well, I’ve worked myself out of another job, mostly, as I assisted the current company into the Amazon cloud. They were operating their system from a hosting environment, so they were mostly in the ‘Cloud’ anyway. And as you might guess I dislike the whole ‘Cloud’ hype as it’s mostly a marketing term. So what I convinced them to do, is improve their scalability by moving the server into the equivalent systems in the Amazon ‘hosting’ environment.

As part of the exercise the database from move from a MySQL database on Windows server, to the Amazon RDS the the webserver/application servers (windows) to EC2 instances, with additional storage in the Amazon S3 facility.

The process was, as usual, a learning experience, and Amazon still has issues with their interfaces to their corner of the Cloud. But it all works, I managed to defrag the database, and apply more indexing and SQL revisions to the point that it runs so smoothly, they don’t need me anymore. Hence the working myself out of a job. Amazon should hire me to sell their services.

 

Learning Computers and Computing

Tags

, , , , ,

I have been doing research into the nature of computers and I’ve been participating with with the phenomena know as Coderdojo. As part of my research I’ve been relearning Assembly language on several different architectures, and I’ve been experimenting with such things a the ELF Membership Card which I soldered myself and is currently running in front of me, along with a Arduino Uno. These both represent small microprocessor, very like the ones I personally started out on.

My first computer was an Apple II+ with a Motorola 6502 processor. But in any case, this act of relearning what a computer really is has made me aware of the lack of any real education ‘tools’ like I had. The sensation that is the Rasberry-Pi is fast becoming the CPU-du-jour of the developers, and as such may develop into a great educational tool. But, and there is always a but, it doesn’t stand on it’s own.

The group who developed the Pi have themselves noted that this is a developmental prototype, and that it needs to be distilled into a real educational product. It first need a keyboard, mouse, display a SD-Memory card and a power supply, to even turn it on. To make it useful as a net-workable it also needs a connection to hardwired Ethernet. It needs to have software preloaded onto the SD-Memory to boot properly. These are Geek requirements, anyone who can make this work, ALREADY has working knowledge and equipment, call it infrastructure, to make this work. What is missing in this is a standalone environment that is self contained and independent of both other systems, and other foreknowledge of computing.

My Apple II came with a keyboard, memory, built-in BASIC programing language, and displayed it’s output into a common Television, and recorded and loaded programs from a simple cassette player. All these elements were basic, everyday items in my household, and it would plug into the mains power directly, and display on a TV. It started up using Applesoft BASIC language and displayed on the screen everything I typed.

The Rasberry-Pi now needs this type of infrastructure. And while on this subject, and not to stir a pot, comes a language issue. The apple I learned on came with BASIC and in fact I still have a fondness for BASIC. The current arguments in the ‘Programming Education’ discussions are that a language like BASIC teaches BAD programming practice. Be in old, I had to remember the motivations of BASIC and was more enlightened to connect this with my reeducation about Assembly language. That was the first reason for BASIC! BASIC is and was engineered to, more or less, follow the structure of the instruction set of the CPU itself. Where language snobs see bad ‘GOTO’s in BASIC, I see machine language Conditional and unconditional ‘Branch’ instructions. Where I see a BASIC with line numbers (not all BASICs have them) I see ‘Linear’ machine instructions.

One element of the Rasberry-Pi that also misses the mark, is the nature of ‘abstraction’ while I admire the Python of the Pi, and the ‘C’ like language of the Arduino, what is missing is the distance between the learner programmer and the actual machine. It may even be a serious problem as the machine begins to look like magic, and that it can be made to do anything.

The programming of the RCA 1802 chip contained in the ELF Membership Card demonstrated what the creator of the card referred to as ‘Bare metal programing’. A simple program that I used to test the ELF with consisted of 12, 8 Bit instructions, writing (essentially) the same program for the Arduino required downloading of 998 8 Bit instructions (not including the 512 Bytes of the boot loader). To be sure there were probably a lot of libraries included in that download. Helpful, but masking the actual operations of the CPU from any real educational product. Just like that Arduino, the Rasberry-Pi will mask the CPU, and the associated hardware by a boot loader (BIOS), followed by a full, though striped to minimum, Linux kernel, and a GUI in the form of LXDE X-Windows, followed by Python language. That’s a lot of abstraction!

All these things may be irrelevant in the long term, one thing may lead to stimulation to explore the ‘Bare Metal’ hardware of the Rasberry-Pi while allowing a positive feedback with easy ‘wins’ on top of the abstraction provided. Still I believe we are missing an opportunity to produce the next generation of computer wizards. I also believe that someone needs to integrate the Rasberry-Pi into a OLPC type of device.

Follow

Get every new post delivered to your Inbox.

Join 376 other followers