Showing posts with label Home. Show all posts
Showing posts with label Home. Show all posts

Sunday, 5 February 2023

Physics Debugger in my Home Game Engine

It may not look much, but this is a huge step forward in my home game engine development.  This is a physics visualization tool I've written, to show me the shapes I register with my physics simulation, it communicates with the game client one frame behind the client, and lets me zoom a camera around the world to see whether shapes line up and to take a snapshot of the physics/collisions being resolved this frame.

The whole physics system is pretty much a bag of spatial checks at the moment, for instance I ray cast from a given point to the four corners of a cube to test whether the point is within, that's pretty compute-intensive.

But at least now I can see there is only one such cube (the purple/pink) one in the scene.

I can also clearly see the ground mesh (the yellow/red triangles).

Infinity is just the blue.


Also, this rendering of the physics world is using yet another renderer I've put together, again integrating ImGui as my defacto GUI in such circumstances.

I need to do a lot of work on this, but it's just a fun project.

And recently having a bit of run, something you can tinker with, something which just makes you think and relax is perhaps key to improving ones skills.

Before I started this whole home game engine (despite working on games at work) I had no idea how to put a renderer together; even as badly as I have; and certainly no idea about a physics engine, now I have the rough knowledge of both.

My home project backing up my experience at work, and also the home project lets me try things I might not otherwise do at work, like totally break things... Oh no wait, I break things all the time....

Friday, 14 October 2022

I love Wales, and I like Scotland..... So IndyRefs?

I'm British.... If we want to delve further into that I was born in England and can trace an 8th of myself to very strong Irish Ancestry, the rest is a bit of Norfolk and a lot of Nottinghamshire.

As a kid I spent time holidaying in North Wales; and of late I've spent a bit of time holidaying on Anglesey.  I like Wales a lot.

I also like Scotland, I had a lovely friend who is Scottish, I've many acquaintances who are Scottish, and I toured Scotland once with notable stops in Dundee and Edinburgh.

Lately the wife and I have even contemplated moving to either country.

However, the thoughts of moving to Scotland were tempered with all this me-gudgeon about IndyRef2.  Now, I thought the matter was settled in the first, it was a close vote, I think every Scottish National voted; and they were out voted by everyone else; there were even a bunch of apathetic people who didn't even bother to vote and still the nationalists were out numbered.

And to be perfectly honest, I think recent times have taught us you're stronger together.  Doubly (or is that quadrupley?) so in terms of the UK.

So hearing all this hoo-haa about the possibility of another referendum and wanting to put things into perspective I took a look at the Scottish Governments own publications; they make for interesting reading.

And I of course focussed on the economy and how Scotland may fair as an independent unit, my question came down to one of Revenue versus expenditure, and to be perfectly honest if I were a Scot asking for independence I'd be scared stiff.

As an Englishman this is perhaps easy for me to say, and feel free to dismiss me; but I'm talking about the FOI-202200277763 publication of the Scottish Government; where it clearly states that "Around 40 per cent of the Scottish Budget 2020-2021 was funded from revenue raising powers devolved to the Scottish Parliament."

40%? Where does the rest of the 60% to keep the country afloat arrive in the coffers from?  "a block grant from the UK Government".

Right, so a lot of money goes into Scotland which it itself can't afford to provide, and I've taken a look, no-one; not one single party calling for IndyRef2 has an answer to this problem.  Indeed they don't ask it, and I find that so very worrying.

I'd even proffer my own opinion that is I, or anyone in Whitehall, asked the question they would have a decorative Shortbread tin stuffed down their gullet faster than you can say "Nicola Sturgeon".

So how do these politicians pulling on the strings of Nationalist Sympathy think the money will come from?  Honestly, I can only believe they think the UK would continue to stump up the cash; forgetting there would be no more UK.

The United Kingdom would cease to exist.

There would be Scotland and then the rest of the Kingdom; England, Wales and Northern Ireland.

Assuming the latter did not continue to fund Scotland, which I believe they would in some way, but assuming that "we" didn't what would the Scottish Expenditure Portfolio become?

Well, I believe Health and Sport would take a hit, particularly Sport.   Quite what the split is between the two is not made clear in 202200277763.  But I think sport would go.

Communities and Local Government is the next big ticket item; well there would not be any "Local" in Government, there would just be the Scottish Government; but does that necessarily spell a saving?  I don't think so, for there would suddenly be a requirement for institutions to facilitate the functions of state.  For example, the Bank of Scotland would have to issue actual currency, Passports, Drivers licensing and control; so many things assumed to cost zero to Scotland today as they're provided services of the state would have to migrate and be picked up by Scotland.

Indeed in the current portfolio "Government Business and Constitutional Relations" shows as zero; because there is none, that cost would sky rocket; more so in a hostile departure from the Acts of Union.

Similarly the "Audit Scotland" would rise, Scottish Parliament too... So many things.

And I can only see the people of Scotland suffering, or the people remaining in the Union being forced to bail out the situation; so I don't get it.

Personally I do not get it, I do not see any need for England, or Wales, to depart the Union, and neither can I see this for Scotland.  It's almost an emotional reaction from some Scots, that they want to be independent, but asking them quite what that means, it means they want the status quo AND freedom; but looking at the books that can't happen.

Whatever your thoughts mine are quite sad, I'm personally strongly against moving to Scotland with this question poised as it is.  I would only move to Scotland if it were part of the Union anyway.


My References:

https://www.gov.scot/publications/foi-202200277763/


https://www.gov.scot/policies/government-finance/setting-the-scottish-budget/


https://yourviews.parliament.scot/finance/scotland-public-finances-23-24/

https://fraserofallander.org/scottish-budget-guide/

https://ifs.org.uk/articles/scotlands-underlying-public-finances-are-improving-oil-and-gas-revenues-rise-long-term

Thursday, 25 August 2022

Home Engine - Blender Export & Model Loading

Some progress in my home engine has been had, first of all multiple geometry rendering through my fixing up and better understanding both render passes and descriptor sets.

All of this is nuts and bolts, what I want to get to; just like the DirectX 11 rendered version; is to play with 3D geometry and placing objects into a scene.

To this end my hand written geometry is no longer hacking it, and you will have seen from my raw game engine posts I did use Milkshape 3D.

Milkshape, lovely as it is to my eye, is not a modern well featured 3D suite and sadly does not let me easily plug into the geometry live within it (one can only export and perform post-processing).

To that end I delved into how one might write a Blender add-on to export your own format...

Long Story short, here's my text intermediate output from just such a plug-in written in python.

The plug-in is far from robust, I followed the lines of another open source plug in and applied my own, copying it into blender with a batch file and clearing the pycache each time I perform an edit.

But it is doing the job I initially want, and I get my own format of file output.

And indeed I can load these into my engine...



I can work on the axis for the data output and start to ensure my camera system from the main client works as expected in vulkan; since the maths here is exactly the same code I don't anticipate any issues.

This should free my mind up to think about a lighting system and to finally get back to where I was with the coloured cubes in the DirectX 11 version and ultimately onto a full scene.

I have four constant things in the world, a ground plane, a skybox and a center marker flag (showing X, Y and Z axis respectively) with a quartet of boxes in the center of the scene.  This is the test scene for the "world" loaded into the scene graph.  And it's where I want this to be this time next week perhaps.

Since progress has been much quicker now I'm past the deep dive into learning the initial set up of vulkan.

I can also appreciate much more why folks just pick up an off the shelf engine, I myself make little prototypes in Unreal Engine 4.  But this kind of denudes me of the walk through these technologies.

For the most part creating an engine like mine, which is planned to have solid shaded low poly vehicular combat, well it's a solved problem, so I'm enjoying following in a lot of well trod foot steps to better my understanding of the processing, memory, mathematics and challenges in writing a game engine.

Friday, 19 August 2022

Home Engine - Set Course for Vulkan

Over the last year I've been experimenting with writing my own home game engine, initially I spent time writing my own line rendering and then a wrapper with SDL2 all using my own mathematics library as a refresher.

Then I set up an engine framework, switched my own none-peer reviewed and frankly shaky maths for glm and started to use DirectX11. You can see a clip in my earlier blog post here.

I dabbled with other graphics interfaces, but ultimately I wanted to land on one of the two big modern interfaces, either DirectX12 or Vulkan.... And since I'm a linux guy at heart Vulkan won out. The difficulty? Well, setting up a Vulkan renderer just to render the "Hello World" triangle is over a 1000 lines of code.... And well, I wanted to write a framework as I went so I could just port this Vulkan back-end work into my abstract renderer API for my existing DirectX11 driven engine. That is my next step, but tonight, after a few hours each night this week I've finally gotten to the 3D step and I'm so excited I wanted to share with you.
So here we see I have multiple pipelines & render passes. It's creating and submitting multiple command buffers, I have integrated ImGui very roughly too.

But this is the first time I've used the uniform buffers, descriptor sets and descriptor layouts to send a uniform buffer (MVP) to the shader and get actual 3D.
I'm strongly following this online tutorial.

Though I also have the Vulkan Programming Guide official book and I'm writing my own functions as I go so the porting to the existing Home Engine API is minimal (or rather as minimal as I can get it).


One of the key pieces of tech in the base engine (driven happily by DirectX 11 when I switch to it) is a full camera fly mode system and a scenegraph rendering models.  I've also got a python driven exporter written for my own model format from Blender (and desperately need to get better with using Blender).  And I have a Python driven project generator (which calls down into CMake quite neatly).

The engine is structured into six major modules:

Base - which contains a host of utility functions, data types and tooling assistance.

Ecs - yes, I'm writing my own Entity Component System.

Renderer - The abstract renderer API which the application level creates and uses in the main game loop.

Application - Main app & game loop, I'm using SDL2 as the main interface here for input & window management in a cross platform manner too.

Physics - A basic hand written rigid body physics implementation, at the moment it really only supports rays, cubes and sphere intersection tests and I'm thinking of shopping around for an off the shelf something.

Game - Contains specific game logic, like spawning, camera controls, input mapping and uses base to provide timing.

This is all very rough and ready, it's a project to keep me interested in my craft really.

And putting Vulkan into the mix has been a real nice way to resurrect where things where, as you may gather I had the DirectX 11 and basic camera system all working in October 2021; but I've been a busy boy since then, both with work, life and moving house....

Now the new office is done and I'm building models in real life, I figured it'd be a nice time to build them in virtual spaces too.


P.S. I have no idea why some blocks are in white backgrounds, very annoying of Blogger to do that?

Wednesday, 2 February 2022

Project Preliminary Fail

I bought some 12V LED filament bulbs for a preliminary delve into a project I'm thinking about building... Only...

That ain't no filament.

Friday, 26 November 2021

Naming a new Storage Server?

 Server names?  In practice I've always been in places or projects where folks are bad at naming things and I am as guilty as the next person in that realm.  I've been on projects naming releases for obscure lord of the rings characters, for characters in a random fantasy story the lead developer had written, for birds, biomes, planets and stars.... Generally these are very niche, if you know the reference you're fine, and it brings a little character to your server.

The trouble arises when a name becomes attached to the history of that thing, the worst I never had was a project with a release named Elrond, where the release itself was re-released, so we ended up with Elrond-2, 3 and 4, then Elrond4RC1 for an update to that successful update, it was just a minefield.

In servers, the worst I ever managed was a box called "Diomede", which would often fail because of bad (read that as cheap) hardware, so the name became inextricably linked to bad performance and issues, despite being a really nice Tomcat & IBM Websphere host with a near 99% up-rate, but that 1% let it down because EVERYONE worked on that one box.

At home at the moment I have:

* Wellington

* Napoleon

* Elba

* Ney

* Waterloo


I'm sure you can tell the reference, but I've had about three versions of "Waterloo", I've also had two versions of "Ney" and at least five "Napoleons".  The names are getting mixed up, as I leave a home project and come back I'll go look up my notes, pull up that machine storage only to realise "oh this was on the OLD version of that name" which was long whisked away into the ethereal world of my replication server or just lost to time.

As such, I want to have ONE big disk server, and I really want to make it nice and neat.   I've already retired all my older machines, like this one:


But I do now have TWO cases of this specification, with the many internal drive bays:


In one of these I have a low-power Core i3 T class CPU, I forget the exact spec, but it's a low-power chip (35W) just enough power to run storage backups IMO, so this is where I'm going to start my quest.

Spinning rust drives are the challenge, I have four 4TB drives just sat idle, plus a host of smaller 1TB drives lying around, these need sorting out, mounting, checking and I then need a strategy.

I'm very likely to go with ZFS creating a mirror across three 1TB for critical storage and then some striped storage across the 4TB drives.  I then want this to make files available across the network, both to my 10GBit and my 1Gbit LAN's.... That's going to require a bit of work to install the former, but the latter should be available out of the box.

This starts to completely retire my 4Gbit fiber channel interconnects too.

So what to name this first stepping stone?.... Comments below:

Elba
Helena

Since it's about storage, I think my theme of names points to one of the islands which hosted Napoleon in exile... but lets see what you guys come up with.




Monday, 20 September 2021

Home Engine - Lines and Camera Interaction

 Yes, yes, it has been a while; both here and on the YouTube channel, I've just been very busy okay?... Okay.  Friends?... Friends.

So what have I been up to in code?... Well today I added line rendering to my home engine, this is still using the underlying "Triangle" raw data, so I have to always have a cleanly divisible by 3 (for the sides of a triangle) number of indices in the data, but otherwise it just seamlessly integrated.

Its using "LineList" as the underlying primitive type, which maps to the D3D11 type under.


I also noticed that these lines from 0, 0, 0 to 1, 0, 0 and 0, 1, 0 and 0, 0, 1 respectively are "backwards", that is my unbeknownst to me at some point my camera has started to spawn around in front of there my scene objects are, so I'm looking back along the Z axis not "up" along it... Am I making sense?

I also improved the camera some by linking the rotation of the camera to the mouse, which makes it super intuitive.

The failed part of the work this last month was an effort to update both the Vulkan and the OpenGL renderer implementation.  This was an utter failure, the simple reason being that I've gone too long with my limited knowledge with DirectX.  I'm sure the "port" to DirectX12 will be easier, but yeah, I've already gotten the other API's so far from my implementation (abstract base classes) that it's quite alien to return to them.

I'll circle back on that, maybe break down the API's with failed/broken builds until I can slowly etch away at the challenge.

Sunday, 14 February 2021

Ship Diorama Build Blog : HMS Rodney : Pt1

The eagle eyed of you will have seen the slew of short model videos going onto my YouTube Channel, and the great and good among you will have subscribed there already, if not the YouTube link is always right there in my blog.

But my new project is a blog exclusive, I'm not planning on filming much of this build, instead we're going to use more high-resolution photographs taken on my phone.

It's also going to be one of the biggest "things" I've ever built.  I've returned to modelling as a hobby in my middle age, but as a kid I was very keen model maker and I had literally hundreds of planes in zoom poses hung from my bedroom ceiling.

But I also had a small fleet, I had the HMS Belfast, HMS Hood and HMS Illustrious in 1/600 by Airfix on my window sill.

In fact in my mid 20's I actually bought and build a second HMS Belfast, which I actually left in my then rented house when I moved out, as I could not find anywhere to put it, but couldn't bring myself to throw her away.

Anyway, I've now decided to start a new fleet and I've decided to go with a 1/700 build of one of my favourite ships HMS Rodney.  Historically this lends some symmetry to my old HMS Hood, as the Rodney exacted terrible revenge by helping to sink the Bismark.

This smaller scale is perhaps my challenge, and the level of detail I want to bring to the model is going to likewise be a challenge.  And I am on the hunt for more detail sets and photo etch to put into use before I get started.  As such, I need to start the model somewhere other then itself, and I've decided on making a diorama.

I can't possibly use epoxy, it's too cold to go work outside and working in my office, I have to be able to put my model making kit all away, so a long cure time is out of the question.  I'm therefore going to start small and simple... I can after all lift the ship back off this base at anytime.


The first step was to use the included base as a template, I tried on card, but immediately saw the materials I had at hand would cause it to disintegrate.  So I found this piece of 2 inch thick polystyrene from a package, and started to mark out the outline.


Next I cut the large sheet to roughly the right size and broke off the excess material.

Next I needed to do some preparation work, I decanted some of my PVA into a spare jar, which has a lid, putting in about 60g of the glue and 80ml of water I shook them vigorously until I had a quite runny PVA mix.






I also retrieved a single piece of aluminium foil roughly the size of the whole base, and I started to roughly layout and gently manipulating the foil to fit like the first layer of my wave effect.
Once I was happy I slipped these aside and painted a layer of neat PVA quite thickly onto the base and then started to place the foil back in place.
making sure to let the foil fall as it liked.

Once it was completely covered I then took single sheets of toilet paper and the PVA water mix and started to layer them over the foil, with the aim of softening the harsh lines, but keeping the pattern random and natural.


Once complete I did a test fit of the plastic base.

And from that alignment started to layout very thin lines of paper and foil atop the current layers, to make an inflection of a bow wave.


A quick test fit.


And once I was happy I got the acrylic paints out, very dilute with water I started with a deep aquamarine gloss from Revell.  Adding a hint of green gave this strong bold colour a real flare of effect.

But, this is only a hint layer and so another layer of toilet paper, single ply this time, was used with the watered down PVA to activate the paint and bring it through.


This further softened the overall wave effect, this is notcable most in the left of field and in the bow wave being much softer and appearing to roll.


A final smattering of watered PVA and I set this whole thing aside.

My plan going forward is to let it dry completely, then trim the excess foil and paper from around the edges, before hitting the glossy acrylic again, but that will be softed with white/grey.  And I'll gloss varnish after that, before picking out the waves with white and giving everything a second gloss varnish.

I've seen a recommendation to use a high gloss varnish of another type, so we'll see... either way, for my first base ever, I'm happy so far, and... it's kept me out of trouble for two and a half hours making it.



See the other parts here:

Saturday, 20 June 2020

The Hot Water Pipe Balls Up

The worst mistake I ever made as a kid.... Was flood the house.

Yeah, so... my parents had a new central heating system put in, all the floor boards up job, British Gas did the work... and for some unknown reason they left all the floor boards up when the finished the job.

To this day, I don't know why they left the job, with hot exposed pipes in the floor space.  But they did... Pinky Swear.

So, Saturday morning my Dad set about putting the floor boards back down, he embroiled me in this, despite my not really knowing one end of a hammer from the other, he put the first board in place and started to put the nails into the holes they had come out of and tamp them down.

He handed me the hammer and said to put in the two nails at my end.... I placed the nail in and hammered it once.... Handing the hammer back to my Dad and we crawled forward to the next joist.

And then I felt wet on my knee... Water was merrily flowing up out of the nail hole and across the wood... warm musky water... heating system water, fresh fernox.

OMG!!!

But my brain said "hey Dad, there's water coming out this wood"... which in retrospect is one of the most spectacular brain farts I can ever imagine, they were the words my brain delivered so my mouth spoke thus.

Panic!!!!

We pull the board up... to put a finger over the hole... but we can't... the hole is in the side of the pipe... the nail had gone down, turned about 60 degree's and gone into the side of the pipe... how it managed this I'll never know, unless I buy that house strip that floor board out and dissect that joist.

So this hole in the pipe was well out of reach below the level of the joist in this cut, you could not put a finger in it... and the heating was on, this water was getting burning hot.

We wrapped towels around it, all sorts, i got scolded pretty badly by it... British Gas wouldn't come back, their home care insurance cover for this didn't cover us for our sticking a nail in the pipe, despite the argument that they pulled the bloody boards up why didn't they put them back down!!?!?!!

To this day I'll never understand why they were left like this.

But this all became my fault.

A plumber arrived about an hour later, he drained the system, cut the pipe, two compression joints and bosh fixed.

I never lived this down of course, this was over 35 years ago, but I still hear about it, and I've even written about it right here, so it plays on my mind.  Not for my ineptitude with a hammer... but for the physics of the thing, how did a nail, driven in straight as far as I could tell... How could it turn like this and stick into a pipe's side, it's lower radius of that side even from a straight above shot?

Pulling it out, the nail had a bend added a perfect bend, as though it had gone slightly into the joist and just turned.  The other nail was still straight and true...

Thursday, 18 June 2020

Brain Dead Boring Boomber Bastards Next Door

Its been over a month, so I've come to terms with something... Some people are just horrid.

We'll just dial back the clock, 1945.... VE Day... All four of my grandparents were serving in the war effort, Solider, Sailor, Nurse & Land Army Girl respectively.  It was their war, their life, and I respect that immensely.

I made a video to that effect a head of VE Day.


However, with the lockdown, my wife and I, being in at risk groups didn't plan on anything for a street party out front, not least as our neighbours, as already mentioned in these pages, are quite abhorrent people breaking the rules and putting themselves and others at risk, but we also had no idea there were any such plans a foot... After all, why risk it when we and all of them are in at risk categories?!?!....

So, we sat it out, rightfully and with respect, I do spend a lot of time with my mind cast back to the world wars and I don't think any of my neighbours, unless there's some secret military historian in their ranks, can touch my knowledge of the struggle and suffering inflicted.

It was therefore with some surprise that I've heard on the grape vine how "disgusted" our direct neighbours were of our "ignoring VE Day" and "disrespecting the spirit of the day".

These fools haven't dared say this to our face, these brain dead boring boomer bastards won't face me and say a word, and you know what... that makes them pretty horrid in my book.

Thursday, 28 May 2020

That Work Life Split Under Covid

With the lockdown and working from home I'm finally doing something I always thought I wanted to do, work from home.  I'd always had the niggling thought I could be more efficient and it would be really good to be able to work from home.  Oh my... Oh Me Oh My How wrong was I?!

The first elephant in the room, work-life-balance, I work in my home office, my home office where I write this blog and make silly videos and play and read... And... so when I've been in it 8+ hours a day, I don't want to look at it any more... I don't sit at my office desk craving to be home chomping on some private project, because I'm already at that home desk and the lines have been blurred.

Second, the family... Specifically (sorry love) the wife... She's no concept of being in the zone, as a programmer, when you're in the zone and been doing something niggly all day and everything is finally falling into place, no matter the time, you stick at it to get done... No, my wife can't comprehend this, she doesn't understand everytime she shouts "Come on now"... It's another 20 minutes because you just mentally ravaged my trail of thought... Put headphones on?... Yeah you don't know how loud my Mrs is.

Third, hours... I touched on it a little above, but there's no quantitative way to express what you're up to.  I feel, quite strongly, that if you're not producing something (like code) and being seen to, you're looking absent from the work place... You're at home, not right there doing your thing.  Recall, I'm quite used to sitting typing for hours on end with folks wondering quite why my keyboard is so loud.  I get a lot of feedback from that presence in the moment in the office.  Without that feedback, I'm feeling more than a little fraudulent, especially as when software engineering tends to do, things go awry and you're then asking for more time... I've literally had 2 weeks on a project, then a week off (yes, I had a week off at home) and then I returned and asked for another 2 weeks... and I'm pretty much about to ask for yet another... based on the original 2 week estimate I over egged this pudding... But I have been working frenetically, except I feel on the other side... they might not see it that way.

Fourth, being somewhere else, this might sound obvious, but I'd never appreciated it, rolling out of bed stretching, getting a coffee and walking a few steps into my chair always felt like bliss, when I did it of a weekend and got on with some project it always felt so right and clean.  Now, it's sullied, it's forced upon me, it's the norm... and to be honest, it's doing my head in.  I miss the commute, the hour to decompress either way.... I miss that moment where I get to just be in my own head, in my own space in the car on the tram or just walking.

Whether that last part of the pre-virus world ever returns, I could not say.

Sunday, 3 March 2019

Home Network Upgrade - Part 1

This is going to have to be a multi-part series, firstly as it's a complex task we've got on, but also time constraints from both my side and also from suppliers delivering me kit means it's already spread itself over three weeks... and I can only imagine it's going to take a lot longer yet.

What am I up to?  Well, we're all settled in the new house and it's time to sort out the networking... Now I only have wireless at the moment, you may have seen my prior posts about the lost router?  Well, I found it... And I was wrong, it wasn't lost at the in-laws, it was lost here.... After searching the garage again, with the wife for that fourth time she finally believed me that it was lost (not just that I was being a stupid man) and she helped look elsewhere... We still didn't find it, however the next day at work my phone rang and on the other end was a joyous voice "I found it, the router, I found it"...

Yes, it was in a box in the garden!

Not open to the elements, but not fabulous either, anyway, router found I stuck it in place.  The problem now, I had two wireless networks the router provided one and the BT Homehub one... Easy, turn the BT Wifi off.... Which I did.

Except, that doesn't turn off the BT Wifi with Fon thing, the free access point for any BT customer to use.  And, I saw folks using my Wifi*

So, I hit the old interwebs and looked up a decent ADSL/VDSL modem replacement, the one which came up, from a video by Cameron Grey actually.  I ordered a Netgear DM200.


It looks quite nice, this is just an ADSL jack in and RJ45 jack out, it is NOT a wifi router.  But, this is an utter and total pig to set up folks, really a total and utter pain in the bum.... I tried three weekends in a row in six different sessions each of over an hour before it finally sorted itself out.

For those interested, flash the firmware to v1.61.  Give it power but no network connections plugged in and hold the factory reset button on the back for 30 seconds, then kill the power to it... Plug in the ADSL feed and connect it with a single ethernet cable directly to your laptop or PC.... Give it power and wait... and wait... and wait... until all three lights go green... If they don't after like fifteen minutes (seriously wait that long), only then remove the connections, but leave the power on factory reset again and power off, connect and power on etc until you get three green lights.

Then on your PC browser open to "http://routerlogin.net" and get in there, and just run the Genie wizard, if ANY thing else comes up, factory reset!  Let it detect BT, enter the username as bthomehub@btbroadband.com no password, nothing else and wait literally tens of minutes, it will get somewhere.  And when it's asking you to register on the netgear site pacify it with the "next" button until it is totally and utterly and completely done.  Only then open another tab and try a website.

When I finally got a website I then removed this hunk of trash.

Finally, no BT Wifi with FON sucking on my juices.  I set the DM200 into modem only mode, wired it to my Router and set up PPPoE with the username and password for BT again... Anyone wondering bthomehub@btbroadband.com and BT, with VLAN set to 101.

And voila, I was back to where I was with my virgin router at the old address, I now have my nice router working nicely with a nice modem on this BT line... And it's about 5mbps quicker on my speed tests, the DNS resolutions (set to Google and CloudFire are around 30ms quicker too).  And I have more control over everything, I am so much happier.

But I'm not altogether happy, because the next phase of my work has been massively massively delayed, by like a year... Like this was planned for the old house... Fiber Optic.

Yeah, remember this box?



Hang on, lets be clear... THIS BOX...


Yes, they are fiber optic network cards... You might ask "Xel why have you so many?"... And I would have to blush and admit, I thought I was buying two as a test, instead I bought TWO JOB LOTS OF 10 CARDS!  So  have this huge box full of 20 fiber optic network cards.

The plan therefore is to put together a small form factor PC by the router and fit a fiber connection to it.   Carry that fiber line up into the loft and up there have a fiber optic router.  That's the ultimate aim.  But I want to do that test first, machine to machine... So, I fitted a card to my workstation and another to my my Xeon home server... All fine, drivers and everything fine, and I set about ordering a pair of short 2 meter cables...

And I wait...

And wait....

And a month later finally....

Oh yeah baby... Except, hang on...


I ordered a pair of cables didn't I... Didn't I... Yes, yes I did... How many are in that baggy?... Just one... OH NO JUST ONE!!!?!?!??!?!!  So, this is where I leave this project for now, it's been a long time coming, but I hope to get the optics test done, then we've got two runs of ether cat 5 or fiber to run from the router feed in down stairs to the loft and then to my office and to the garage.

As owning a garage, this is where I now plan to have the server rack, and running fiber to it may be my optimal solution, it may even be possible to get cat 5 into the garage easier than to the loft, so all the fiber might go in the garage, this is literally a plan in the process of being figured out as I find out the structure and layout of the house.

Stick around for more.



* I actually spoke to a neighbour about this, he said "Oh that'll be my lad, he connects to the as many BT Wifi connections for free, we don't pay for the internet that way".... Nice, thanks... 

Sunday, 25 November 2018

Scary Big Brother Moment

I have just ordered a mail redirection, as part of our move to the new house... And at the end the Royal Mail ask you a series of security questions to "confirm" your identity....

OH MY GOD

They are the most scary things to see, they were asking me questions about old addressed (totally unrelated to the addresses being redirected) they ask about current accounts opened sixteen years ago, they ask about my previous mortgages outstanding balance... Really scary things, and if you get the questions wrong they tell you, they know the answers.

This is the most scary thing... I could sit with a credit card, paying a fee (I admit) and putting in the personal data of other people I know and I could learn new secret private information about them, okay they asked me three four different previous addresses... Only one applied to me... But, if you cross referenced this you could build a big picture about people...

I'm honestly scared by something so mundane having access to so much private information.

Anyway, with the move now underway, expect more silent silence from me... Sorry

Monday, 10 September 2018

Ikea Server Rack is Finished

What kind of bloke gets to play with servers on his day off?  A damn lucky one my wife always tell me?.. Am I lucky?  Or do I have a plan?  I think I have a plan, this is a project I've been meaning to sort out for quite some time, now I have a week off of work, I'm knocking things out the park... Sooo......


Meet my new server wrack, so this is a pair of Ikea Lack Coffee tables, one with the feet fitted, and it's screwed down onto the top of another, with a pair of wheel which I also got at Ikea.

I've reinforced the leg uprights, and I'm busy fitting out the rear with a dedicated switch and power setup.

It's all on wheels so it can go anywhere in my office with relative ease.

And yes, these are my older Poweredge servers (from my fan/noise reduction videos).

Only the top unit is operational, with all the drives fitted and a full compliment of memory (64GB I think is in it).  Its socking a quad port gigabyte Ethernet at the moment but I have a whole box of fiber channel cards to go into the machines up here taking me up to 4Gbit per card (full duplex) and I plan to fit two cards in each machine so we should bond up to about 8gbits... We'll see, waiting on the cables to arrive from Hong Kong.


My other item is to get myself a dual Socket 1366 based server soon, just to play about with 6 core 12 thread CPU's (so up to 12 cores 24 threads) and perhaps in the new year I'll go up to the E5- series of Xeons to massive amounts of threads.

At the moment though, load balancing various things on my AWS instances and dropping to my own hosting is more my interests...

And a friend of mine has reminded me of a project he and I need undertake - watch this space.

Saturday, 3 February 2018

Home Server - New Case (Coolmaster N300)

The new home server build starts with the case, I've elected to go with my wallet, and this means the cheapests ATX case with the mode drive bays...

The Coolmaster N300 comes in at just over £38 and sports an impressive 8 internal 3.5" drives.


Thursday, 1 February 2018

Intel Home Server CPU

You're all aware (I hope) of my stack of servers under the desk, however, the main server I use is actually a re-purposed desktop - it's the G33 chipset Socket 775 to Socket 771 running a Xeon E5420...

And I have my plan forming to re-case my main workstation, however, I wondered... As I'm currently very exposed with data not replicated across drives on my little server and the machine being quite high power, whether I might not do better in the short term of recasing both... AND changing the server to an always on box.

This way, I could build a machine around a dedicated new board and chip... I started out with the AMD APU's the 2580 and some others, up to a quad core, and as fabulous as they look on cost they didn't float my boat.

I don't need a lot of number crunching power on the server, so what was my concern?  Well, I'm an Intel guy... Always have been, and think I always will be.  Obviously I started with MOS processors, then moved into the world of Motorolla, but since 1994 I've steadfastly bought and used Intel.

Why? Well, I remember the original AMD offerings, they were copies, and hard to find in the UK market without knocking the quality of other items in your build, so I stuck with off the shelf Intels.

I then build my own Pentium II and III computers, I also found use for Celerons - I've never had anything against them - I had a Pentium IV Prescott when they were literally brand new, then I've had the Core i7 950, plus all the Xeon servers and modding fun.

At work I've always been supplied Intel too...

What options does the market offer in the Intel world?.... Well I spotted the dual core, dual thread Celeron G9300.... Which looks just the ticket for me, it's pretty low power (53W compared to the Xeon E5420 at 80W), it can address more RAM, so giving me expansion options and it had decent reviews.  The trick is to not expect a lot from it, and to actually put it to a good use.  If that use is as an SSH point into my network, a git server, NFS host and squid box, then that might work quite well.

I've therefore drafted a build, you can see it here.... 

If nothing else that case, might be a perfect buy, to get the ball rolling, and guess what!... Tomorrow is pay day.